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The purpose of this study was to examine the changes in 19 preservice chemistry teachers’ 
understandings of the structure of matter, including the aspects of the physical states of 
matter, the physical composition of matter, and the chemical composition of matter, before, 
immediately after, and months after they received a specific instruction. The one-group pre, 
post, and delayed posttest design was used, and participants’ understandings before, 
immediately after, and months after the instruction were assessed using the same “three part 
particulate drawing” classification question constructed by Sanger (2000). Collected data 
were analyzed according to both the number of scientifically appropriate classifications, 
and the types and nature of scientifically inappropriate classifications made by preservice 
teachers. The results of these two analyses were quite parallel to each other and showed that 
this specific instruction promoted the development of participants’ scientific understandings 
of the structure of matter. It should be noticed that while the effect of the instruction 
appeared extremely positive based on the results of the statistical analyses which solely 
compared the number of scientifically appropriate classifications, it was reflected more 
accurately after the participants’ scientifically inappropriate classifications of the structure 
of matter were analyzed more thoroughly. It was also found that although some 
scientifically inappropriate classifications were changed to scientifically appropriate ones 
following the instruction, some of them reverted back to their initial status months after the 
instruction. 

Keywords: conceptual understanding; multiple representations in chemistry; preservice chemistry 
teachers; teacher education 


Introduction 

Conceptual understandings and the associated alternative conceptions in chemistry have occupied 
researchers’ attention for more than 30 years (Duit, 2009; Garnett, Garnett, & Hackling, 1995). 
Previous research has shown that students at all grade levels encounter conceptual difficulties even 
with basic chemistry concepts, and they often develop conceptions which differ from those 
accepted by the scientific community (Kind, 2004; Taber, 2002). Some of these conceptions derive 
from individuals’ direct or indirect observation of, and spontaneous everyday interaction with, the 
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natural world around them (Driver, Squires, Rushworth, & Wood-Robinson, 1994). Other sources 
of these conceptions might be textbook misrepresentations, misleading everyday language, and 
even the act of teaching itself due to inappropriate instructional materials or teachers’ own 
alternative conceptions (Adbo & Taber, 2009; Duit & Treagust, 1995; Lin, Cheng, & Lawrenz, 
2000 ). 

The extent of teachers’ subject matter knowledge and the nature of their alternative 
conceptions may affect how their students understand the concepts. According to Shulman (1987), 
in order to be able to teach all students, teachers need to hold deep conceptual understandings of 
the subject matter, but several research studies have reported that preservice and inservice teachers 
have diverse nonscientific conceptions about fundamental concepts of chemistry (Azizoglu, Alkan, 
& Geban, 2006; Banerjee, 2001; Calik & Ayas, 2005; Canpolat, 2006; Canpolat, Pinarbasi, & 
Sozbilir, 2006; Gabel, Samuel, & Hunn, 1987; Ginns & Watters, 1995; Haidar, 1997; Kokkotas, 
Vlachos, & Koulaidis, 1998; Kruse & Roehrig, 2005; Lin et al., 2000; Ozden, 2009; Taber & Tan, 
2011; Tan & Taber, 2009; Valanides, 2000). Moreover, some of these studies have identified 
similarities between students’ and teachers’ alternative conceptions (Calik & Ayas, 2005; 
Kokkotas et al., 1998; Lin et al., 2000; Valanides, 2000). This indicates a potentially crucial 
problem, in that if teachers do not hold scientific understandings, they may pass these alternative 
conceptions on to their students (Kruse & Roehrig, 2005; Taber & Tan, 2011). Teachers with 
limited subject matter knowledge may not be aware of students’ alternative conceptions and may 
not be able to offer viable explanations to their students (Jarvis, McKeon, & Taylor, 2005). 

The existing literature (Calik & Ayas, 2005; Haidar, 1997; Kokkotas et al., 1998; Kruse & 
Roehrig, 2005; Lin et al., 2000; Taber & Tan, 2011; Valanides, 2000) consistently recommended 
addressing students’ alternative conceptions with proper instructional activities and making 
teachers, particularly preservice teachers, aware of their own alternative conceptions through 
specific instructions before they go into teaching practice. Since teachers are charged with 
developing scientific understandings, the instruction offered for preservice science teachers in 
teacher education programs and for inservice teachers in workshops needs to be arranged around 
the idea of eliciting and building teachers’ own conceptions and encouraging teachers to develop 
the teaching skills to continuously promote scientific conceptual understandings among students 
(Kruse & Roehrig, 2005; Valanides, 2000). 

As a response to this call, in the present study, a specific instruction was designed to 
improve preservice chemistry teachers’ understandings of the structure of matter. This instruction 
provided participants with activities to uncover and restructure their conceptions about the 
structure of matter. These activities involved examining and building multiple molecular 
representations of matter with their peers in groups, as well as discussing and reflecting on their 
understandings of matter. 

Theoretical Background 

Understanding the structure of matter is part of a targeted concept in school science curricula 
worldwide, for Grades 6 through 12. Students are expected to understand the structure of matter at 
three physical states, and they should be able to recognize and classify the elements, compounds, 
pure substances, and mixtures at different representational levels. Developing a scientific 
understanding about the structure of matter is essential for learning advanced chemistry topics 
(Gabel, 1993; Haidar & Abraham, 1991; Harrison & Treagust, 2002). Previous research mostly 
focused on identifying and describing elementary through university students’ alternative 
conceptions about the particulate nature of matter [PNM] (e.g., Griffiths & Preston, 1992; Liu & 
Lesniak, 2005; Margel, Eylon, & Scherz, 2008; Novick & Nussbaum, 1978; Pozo & Gomez- 
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Crespo, 2005; Sanger, 2000; Stains & Talanquer, 2007a, 2007b; Williamson, Huffman, & Peck, 
2004; among others). However, research into preservice teachers’ conceptual understandings of 
the nature and structure of matter (Gabel et al., 1987; Ginns & Watters, 1995; Kokkotas et al., 
1998; Valanides, 2000) is limited in number and considered only preservice elementary science 
teachers. There are some studies examining high school preservice chemistry teachers’ conceptual 
understandings, but none of these were related to the nature and structure of matter, instead related 
to concepts of phase equilibrium (Azizoglu et al., 2006), chemical equilibrium (Banerjee, 1991), 
gas laws (Lin et al., 2000), ionization energy (Tan & Taber, 2009), and conservation of mass 
(Haidar, 1997). 


Research into Preservice Teachers’ Understanding of the Nature and Structure of Matter 

In order to identify preservice elementary teachers’ views of the PNM, Gabel and her colleagues 
(1987) expected the participants to distinguish elements, compounds, mixtures, substances, 
solutions, solids, liquids, gases, and chemical and physical changes at the submicroscopic level. 
The findings from this study indicated a lack of understanding of the PNM and the existence of 
various alternative conceptions, such as enlargement of particles as the substance change from 
liquid to gas. 

Ginns and Watters (1995) also conducted a study with preservice elementary teachers, and 
the results revealed that some participants were “unable to conceptualize the behaviour of matter at 
the particulate level in order to explain phenomena of the kind embodied in the question, and, 
therefore unwilling to use the terms atom, molecules, and even particle” (p. 215). In addition, 
Valanides (2000) found that the majority of preservice elementary teachers in the sample exhibited 
perceptual rather than conceptual understanding of the PNM, and they had difficulties in relating 
the macroscopic changes to the submicroscopic occurrences (e.g., arrangement and movement of 
particles). These participants stated that individual particles share the observable properties of 
matter and combine together to produce new molecules, but they could not realize the changes in 
the structure and the properties of matter. 

In this respect, research in science education has strongly suggested utilizing more 
effective teaching methods in teacher education courses in order to develop a sound understanding 
of fundamental chemistry concepts among preservice teachers (Calik & Ayas, 2005; Calik, Ayas 
& Coll, 2007; Ginns & Watters, 1995; Haidar, 1997; Kruse & Roehrig, 2005; Valanides, 2000; 
among others). The following section summarizes a few attempts in this direction to respond these 
suggestions. 


Instructional Attempts to Develop Preservice Teachers’ Understandings of Chemistry 
Concepts 

Ko kk otas et al. (1998) attempted to improve preservice elementary teachers’ knowledge about the 
PNM. In doing so, preservice teachers were confronted with actual students’ responses about 
matter and its transformations. Preservice teachers first evaluated the students’ responses, then 
discussed, in small groups, their opinions about these responses and possible obstacles to learning 
these topics, recommended appropriate teaching activities for eliminating these obstacles, and 
lastly re-evaluated students’ responses. The results from that study showed that many participants 
initially tended to lack scientific understanding about the PNM, but showed substantial 
improvement after the instruction. 

Jarvis and her colleagues (2005) specifically designed an instruction to support the 
preservice elementary teachers’ science subject matter knowledge. In this instruction, the 
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participants were initially encouraged to become aware of the limitations of their own knowledge. 
Then, experiences were provided to challenge their existing ideas and to help them reach the 
scientific view through discourse and practical, active, and collaborative learning. The results from 
the study indicated a substantial conceptual improvement among the participants following the 
instruction. Taylor and Coll (1997) tested the use of an analogy for addressing a common 
alternative conception of preservice elementary teachers regarding the dissolving process. A 
bridging analogy was utilized to act as a bridge between the anchoring situation (dissolving of 
potassium permanganate) and the target situation (dissolving of sugar). In another study, Calik et 
al. (2007) used conceptual change texts to overcome preservice elementary teachers’ alternative 
conceptions about solution chemistry. Their findings showed that the use of conceptual change 
texts was a cost-effective and resource-effective way to improve the participants’ conceptual 
understanding of the dissolving of solids in water. 

Although all these instructions adapted by aforementioned studies targeted preservice 
teachers’ understandings of particular concepts, none of them addressed the concepts similar to the 
ones dealt with in the present study. Moreover, Sanger (2000), and Stains and Talanquer (2007a) 
in their studies addressed the similar concepts as in this study, but they worked with university 
chemistry students rather than preservice chemistry teachers. 

For example, Sanger (2000) developed and used the particulate drawings (which were also 
used in the current study) in interviews to identify the ways students classify these particulate 
drawings as pure substances, heterogeneous or homogeneous mixtures. Then, Sanger designed an 
instruction based on the results of the interviews such that he provided some macroscopic samples 
in test tubes and showed their submicroscopic computer-generated visuals, and students classified 
the given particulate representations. This was an attempt to explicitly link different 
representations of the given substances. 

In addition, Stains and Talanquer (2007a, 2007b), without any instruction, asked the 
participants to classify chemical substances as elements, compounds or mixtures based on their 
particulate representations similar to the ones used in this study. They identified the patterns of 
reasoning used by undergraduate students in classifying chemical substances. 

Multiple Representations in the Teaching and Learning of Chemistry 

Many chemical phenomena happen at the submicroscopic level and are not accessible to direct 
observation (Gabel, 1998). Thus, a full understanding of chemistry requires students to “make 
sense of the invisible and untouchable” (Kozma & Russell, 1997, p. 949). In other words, for 
developing a scientific understanding of a phenomenon, students need to properly relate the three 
levels of representation to one another (Gilbert & Treagust, 2009; Kozma, 2003). The three levels 
of representation include: (a) macroscopic refers to tangible, visible, and edible aspects of matter 
(b) submicroscopic provides information about atomic, molecular, and kinetic aspects of matter, 
and (c) symbolic involves the use of symbols, formulas, and diagrams (Gabel, 1998; Johnstone, 
1993). For example, the symbol of FF(g) submicroscopically refers to the diatomic molecules 
existing at gas state; whereas macroscopically it is a colourless and odourless gas, weighing 2 
grams per mole. 

Cheng and Gilbert (2009) claimed that to conceptually learn science, students need to 
understand the various representations of science concepts, be able to translate between different 
representations, as well as demonstrate a capacity to construct a representation in any form for a 
given purpose. Even if the simultaneous use of the three levels of representation holds the promise 
of promoting student learning (Ardac & Akaygun, 2005; Tasker & Dalton, 2006), learning 
from/with multiple level of representations can be a difficult task for students. For example, 
Hinton and Nakhleh (1999) found out that although all of the participants were able to identify 
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macroscopic changes as evidence for chemical reactions and perform algorithmic calculations 
involving chemical reactions, none of the students demonstrated a clear understanding of the 
submicroscopic nature of chemical reactions. 

The cognitive theory of multirepresentational learning (Mayer, 2009) also supports the use 
of multiple representations for instructional purposes. Mayer (2003) claimed that “students learn 
more deeply from a multimedia explanation presented in words and pictures than in words alone” 
(p. 131). This is because the extent of knowledge processed on two channels is greater than that 
processed on one channel. In addition, using multiple representations in instruction alleviate 
possible cognitive load in learning complex concepts (Sweller & Chandler, 1991). 

According to Mayer (2009), multirepresentational learning is based on three assumptions: 
dual-channel, limited-capacity, and active processing (Mayer, 2003, 2009). The pictures (e.g., 
static particulate drawings or dynamic particulate animations) and words (e.g., oral or textual 
narrations of relevant pictures) from external sources are detected through either eyes and ears, and 
students selectively register incoming pictures and words and transmit them to their working 
memory for further processing by the visual and/or the verbal channel. Students actively process 
the selected pictures and words by either directly organising them as verbal and visual 
representations, or turning either one into the other form of representation to be further processed 
in a different channel. After a set of selecting and organising processes, students construct a verbal 
and/or visual mental representation of the phenomena. Then, they build referential coherent links 
between the verbal and the corresponding visual mental representation as well as integrating them 
with the relevant aspects of existing prior knowledge from long-term memory. 

To address the challenges students encounter while moving between three levels of 
representation, researchers suggested engaging students with dynamic, multirepresentational 
visualizations of invisible phenomena, and among these are technologies that include animations 
and simulations of phenomena with multiple levels of representation (e.g., Ardac & Akaygun, 
2005; Kozma & Russell, 1997; Sanger, 2000; Tasker & Dalton, 2006; Williamson & Abraham, 
1995; Yezierski & Birk, 2006). In fact, during the instruction, teachers need to help students 
become explicitly aware of the relationship between the expressed and represented world and 
connect various representations together (Hinton & Nakhleh, 1999; Tasker & Dalton, 2006). Many 
studies conducted with students (not preservice teachers) have suggested that the careful use of 
multiple representations not only offer students opportunities to improve their conceptual 
understanding of chemistry but also expand our understanding of how students interpret and utilize 
such representations for making sense of the given phenomena (Ardac & Akaygun, 2004, 2005; 
Chandrasegaran, Treagust, & Mocerino, 2007, 2008; Ebenezer, 2001; Sanger, 2000; Stieff, 
Hegarty, & Deslongchamps, 2011; Tasker & Dalton, 2006). 


Purpose and Research Questions of the Study 

Based on the reviewed literature, it seems that there is a lack of research which concerns about 
developing preservice chemistry teachers’ conceptual understanding in fundamental chemistry 
concepts by using multiple representations during the teacher training. So different than the other 
studies mentioned in the previous section, this study integrated the use of multiple representations 
(via paper clips, play-dough, dynamic computer animations, verbal explanations, and pictorial 
drawings) into an instruction intended to enhance preservice chemistry teachers’ understandings of 
the structure of matter. 

The purpose of the study was to examine the changes in preservice chemistry teachers’ 
understandings of the structure of matter, including (a) the physical states of matter, (b) the 
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physical composition of matter (pure substance, mixture), and (c) the chemical composition of 
matter (only elements, only compounds, and both) before, immediately after, and months after 
they received a specific instruction. The following research questions guided the study: 

(1) How does the number of scientifically appropriate classifications of preservice 
chemistry teachers for each aspect of the structure of matter change from pre to post and 
then to delayed postinstruction? 

(2) How do preservice chemistry teachers’ scientifically inappropriate classifications for 
each aspect of the structure of matter change from pre to post and then to delayed 
postinstruction? 

While the first question focused on the number of scientifically appropriate classifications 
before and after the instruction by using a quantitative perspective in data analysis, the second one 
aimed at understanding the changes in the type of scientifically inappropriate classifications after 
the instruction from a qualitative perspective. 

Methods 

Design 

This is a longitudinal study of one-group quasi-experimental design with a pre, post, and delayed 
posttest (Campbell & Stanley, 1966; White & Arzi, 2005). This study qualifies to be a longitudinal 
study, as it meets the criteria of multiple measures and a long duration of time (17 months) 
between the first and last measure (White & Arzi, 2005). 


Participants and Setting 

The participants of the study consisted of 19 preservice chemistry teachers, including 10 female 
and 9 male. These participants were third-year students in a five-year teacher education program. 
All participants completed not only introductory level chemistry courses in which the aspects of 
the structure of matter were addressed, but also advanced chemistry courses such as inorganic 
chemistry, analytical chemistry, organic chemistry, etc. The study was conducted in a secondary 
school laboratory applications course offered by the second author of the study. In this course, the 
course instructor created a learning environment in which preservice teachers could gain first-hand 
experience with contemporary instructional approaches, as well as develop their scientific 
understandings of relevant topics such as the structure of matter. 


Framework of the Instruction 

Drawing upon the information about student learning provided by Mayer (2003, 2009), the 
instructional implications of three aspects of chemistry (macroscopic, submicroscopic, and 
symbolic) (Gabel, 1998; Johnstone, 1993), and the recommendations of several studies (Ardac & 
Akaygun, 2004, 2005; Chandrasegaran et al., 2007, 2008; Hinton & Nakhleh, 1999; Sanger, 2000; 
Stieff et al., 2011; Tasker & Dalton, 2006; Tsai, 1999) about the use of multiple representations in 
teaching practice, the following instruction was designed. In this instruction, multiple 
representational tasks, combined with collaborative group work, discussion, and self-reflection, 
provided preservice teachers an opportunity for generating more scientific representations of 
matter. Summary of the instruction can be seen in Table 1. 
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Table 1. Summary of the specific instruction 


Tasks 


Instmctional Approaches 


Classifying different arrangements of coloured 
paper clips as either a mixture or a pure substance 

Representing a solid (iron), a liquid (water), and a 
gas (oxygen) at the particulate level 


Representing atoms, molecules, elements, 
compounds, pure substance, and mixtures 


Group work 

Whole-class discussion 

Pictorial particulate drawings (individually 
represented) 

Whole-class discussion 
Viewing dynamic representations 
(animations) of solids, liquids, and gases 
Comparing and contrasting the particulate 
drawings and dynamic representations 
Defining each term 

Pictorial particulate drawings of each one 
(individually represented) 

Whole-class discussion 
Viewing dynamic representations 
(animations) of elements, compounds, and 
mixtures 

Representing an element, a compound, and a 
mixture using a play-dough 
Sharing of play-dough representations 


The instruction was completed in two phases and lasted 3 class periods. In the first phase, 
the participants engaged in a task adapted from Blake, Hogue and Sarquis (2006). They worked in 
groups of three or four, and each group was provided with seven zip-lock bags containing different 
arrangements of coloured paper clips, each of which represented either a mixture or a pure 
substance (element or compound). The participants identified the contents of each bag, classifying 
them either as a mixture or a pure substance, and then described the composition of each bag in 
detail. Once the participants finished this task, the instructor initiated a whole class discussion by 
soliciting each group’s ideas about the composition of each bag (e.g., “Bag 1 represents a mixture, 
and it is a mixture of compounds”). Following the discussions among groups, the participants 
reached a consensus view about the contents of each bag. 

In the second phase, the participants first represented a solid, a liquid, and a gas at the 
particulate level by using just closed circles P ] without concerning about the representation of 
atoms, molecules, or ions; however, they considered the arrangement and spacing between the 
particles of a solid, a liquid, and a gas. Subsequently, the instructor initiated a discussion on the 
behaviour of solids, liquids, and gases at the particulate level; thus, the participants shared their 
representations along with their explanations regarding the behaviour of the particles of solids, 
liquids, and gases. Then, the participants viewed the dynamic animations of solids, liquids, and 
gases for about a minute (see http://www.chem.purdue.edu/gchelp/ atoms/states.html) and 
compared with their own representations in terms of the arrangement and spacing of particles. 
Afterwards, the participants worked in groups, and responded the questions in activity sheets that 
asked them to verbally define the terms of an atom, a molecule, an element, a compound, a 
mixture, and a pure substance, and pictorially represented each one at the submicroscopic level by 
selecting a specific element, compound, mixture, and a pure substance. Then, a whole-class 



116 Yakmaci-Guzel &Adadan 


discussion was held concerning such terms so that each group was shared their verbal expressions 
of each term with the class, and students developed a consensus view about each term. Then, the 
participants viewed the dynamic representations of elements (including both atomic and molecular 
element), a compound, and a mixture for about two or three minutes (see 
http://www.chem.purdue.edu/ gchelp/atoms/elements.html). After that, students individually 
represented their selected examples of each category [the ones that they represented on the paper] 
at the submicroscopic level using play-dough. While representing their choice for each category, 
students were asked to pay particular attention to the physical state of the selected element, 
compound, and mixture at room temperature. Once the participants completed the play-dough task, 
they shared their representations with their classmates and received feedback from their peers and 
instructor. 


Data Collection 

Several researchers have recently used questions that included particulate drawings instead of 
numerical problems because research indicated that students who are successful at solving 
numerical problems may not understand the concepts underlying these problems (Nurrenbern & 
Pickering, 1987; Sanger, 2000; Stains & Talanquer, 2007a, 2007b). Drawing upon this finding, 
this study assessed preservice chemistry teachers’ understandings of the structure of matter before, 
immediately after, and 17 months after the instruction using the same “three-part particulate 
drawing question” constructed by Sanger (2000) (see Appendix A). This task presented five 
pictures representing five different matters at the submicroscopic (molecular) level. In the pre, 
post, and delayed postinstruction measurements, the participants were asked to classify each of the 
five given pictures according to: (a) its physical state (solid, liquid, gas), (b) its physical 
composition (pure substance, homogeneous mixture, heterogeneous mixture), and (c) its chemical 
composition (element/s only, compound/s only, and both), and to write down justifications for 
their classifications. The participants took the pretest at the beginning of the Autumn Semester 
(last week of September), and the instruction was implemented in the middle of November. The 
participants took the posttest after the instruction, and the delayed posttest was administered 17 
months after the instruction. Each time, the participants answered “the three part particulate 
drawing” question within 20 minutes. 

Data Analysis 

For quantitative analysis of the data, one point was assigned for each scientifically appropriate 
classification about the given particulate drawings. The maximum score for each part of the 
question was five, and the possible maximum total score was 15 (see Appendix A for scoring). 
The total numbers of scientifically appropriate classifications for each part were added up for each 
participant and their total scores were calculated at three data collection instances (i.e., pre, post, 
and delayed posttest). Numerical data was analyzed using statistical analysis in order to detect 
changes due to instruction, if any. The Wilcoxon-signed ranks test was utilized to compare the 
participants’ scores for each aspect of the structure of matter and their total scores from pre to 
postinstruction, from pre to delayed postinstruction, and from post to delayed postinstruction. The 
Wilcoxon signed-ranks test is a non-parametric statistical test for comparing two related samples 
or repeated measurements on a single sample to assess whether their population mean ranks differ 
(Gibbons, 1993). Therefore, it can be considered the non-parametric counterpart of the paired- 
samples t-test. 

Apart from the aforementioned analysis, which took into account the scientifically 
appropriate classifications, the data were also analyzed in order to identify the types of 
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participants’ scientifically inappropriate classifications at three data collection instances. In doing 
so, a frequency count was performed for each kind of scientifically inappropriate classifications on 
the pre, post, and delayed posttest. Researchers also read through the participants’ written 
justifications for their classifications to understand their way of thinking. These written 
justifications provided evidence for the participants’ conceptions about the nature and structure of 
matter. Some representative examples among these written justifications were given in the “results 
and discussion” section to offer the reader an idea about the participants’ reasoning. 


Results and Discussion 

Research Question 1: How does the number of scientifically appropriate classifications of 
preservice chemistry teachers for each aspect of the structure of matter change from pre to post 
and then to delayed postinstruction ? 

Table 2 shows the pre, post, and delayed posttest mean scores and standard deviations for each 
aspect of the structure of matter: (a) the physical state of matter, (b) the physical composition of 
matter, (c) the chemical composition of matter. 

Table 2. Descriptive statistics for the participants’ scientifically appropriate classifications in 

each testing instance 


Testing 

instances 

Part (a) 

Part (b) 

Part (c) 

TOTAL 


Mean 

SD 

Mean 

SD 

Mean 

SD 

Mean 

SD 

Pre 

4.05 

0.89 

2.21 

1.57 

3.58 

1.39 

9.95 

2.91 

Post 

4.84 

0.36 

3.11 

1.25 

4.26 

1.37 

12.21 

2.59 

Delayed post 

4.68 

0.80 

3.05 

1.47 

4.16 

0.81 

11.89 

2.25 


Table 2 above shows increases in terms of preservice chemistry teachers’ mean scores 
(obtained with respect to their scientifically appropriate classifications) from pre to posttest and 
from pre to delayed posttest, but to understand whether these positive changes are statistically 
significant or not, Wilcoxon-signed ranks test was used. This test first subtracts the score taken in 
a testing instance (let’s say pre-measurement) from the score taken in another testing instance 
(let’s say post-measurement) for each pair, and then takes absolute values of these differences and 
ranks them, and lastly calculates a Z score and significance level from these values. 

When the pre and posttest scores for each part of the question were compared, the test 
statistics indicated a statistically significant difference between the participants’ pre and 
postinstruction understandings of the states of matter (part a) (z = 2.88, p<0.005), the physical 
composition of matter (part b) (z=2.77, p<0.01), and the chemical composition of matter (part c) (z 
= 2.18, p<0.05). In addition, there was a statistically significant difference between the 
participants’ total pre and total posttest scores (z=3.34, p=0.001) (see Table 3). 
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Table 3. The Wilcoxon-signed ranks test statistics for changes in the participants’ number of 
scientifically appropriate classifications from the pre to posttest 


Difference between test scores 

Ranks 

N 

Z 

Asymp. sign. 
(2-tailed) 

Post (a) - Pre (a) 

Positive ranks 3 

10 

2.88 

0.004 


Negative ranks 1 * 

0 




Ties c 

9 




Total 

19 



Post (b) - Pre (b) 

Positive ranks 

10 

2.77 

0.006 


Negative ranks 

1 




Ties 

8 




Total 

19 



Post (c) - Pre (c) 

Positive ranks 

11 

2.18 

0.029 


Negative ranks 

2 




Ties 

6 




Total 

19 



Post (Total) - Pre (Total) 

Positive ranks 

14 

3.34 

0.001 


Negative ranks 

1 




Ties 

4 



a t-» . / \ . r» / \ b t-» ,/\ 

Total 

T~» / \ C T» , / \ 

19 




a : Post (a) > Pre (a); b : Post (a) < Pre (a); c : Post (a) = Pre (a) 


When the participants’ pre and delayed posttest scores for each part of the question were 
compared (see Table 4), the test statistics resulted in statistically significant differences in terms 
of the participants’ understanding of the states of matter (part a) (z=2.29, p<0.05), and the physical 
composition of matter (part b) (z=2.51; p<0.05), but there was no statistically significant 
difference between the participants’ pre and delayed posttest scores on the aspect of chemical 
composition of matter (part c) (z=1.81, p>0.05). On the other hand, there was a statistically 
significant difference between participants’ total pre and total delayed posttest scores (z=2.79, 
p=0.005). 

However, when the participants’ post and delayed posttest scores for each part of the 
question were compared (see Table 5), there was no statistically significant difference between 
post and delayed posttest scores for any part of the question or for the total score (part a; z=-0.71, 
p>0.05; part b; z=-0.58, p>0.05; part c; z=-0.80, p>0.05; total score; z=-1.20, p>0.05). Based on 
these results, it appears that the instruction substantially increased the number of participants’ 
scientifically appropriate classifications about the structure of matter. In addition, it is important to 
note that no statistically significant difference was found between post and delayed posttest scores, 
which implies a long-lasting positive impact of the specific instruction. 
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Table 4. The Wilcoxon-signed ranks test statistics for changes in the participants’ number of 
scientifically appropriate classifications from the pre to delayed posttest 


Difference between test scores 

Ranks 

N 

Z 

Asymp. sign. 
(2-tailed) 

Delayedpost (a) - Pre (a) 

Positive ranks 3 

9 

2.29 

0.022 


Negative ranks'* 

2 




Ties c 

8 




Total 

19 



Delayedpost (b) - Pre (b) 

Positive ranks 

9 

2.51 

0.012 


Negative ranks 

1 




Ties 

9 




Total 

19 



Delayedpost (c) - Pre (c) 

Positive ranks 

8 

1.81 

0.070 


Negative ranks 

3 




Ties 

8 




Total 

19 



Delayedpost (Total) - Pre (Total) 

Positive ranks 

11 

2.79 

0.005 


Negative ranks 

2 




Ties 

6 




Total 

19 




a : Delayed Post (a) > Pre (a); b : Delayed Post (a) < Pre (a); c : Delayed Post (a) = Pre (a) 


Table 5. The Wilcoxon-signed ranks test statistics for changes in the participants’ number of 
scientifically appropriate classifications from the post to delayed posttest 


Difference between test scores 

Ranks 

N 

Z 

Asymp. sign. 
(2-tailed) 

Delayedpost (a) - Post (a) 

Positive ranks 3 

2 

-0.71 

0.480 


Negative ranks'* 

3 




Ties c 

14 




Total 

19 



Delayedpost (b) - Post (b) 

Positive ranks 

4 

-0.58 

0.560 


Negative ranks 

6 




Ties 

9 




Total 

19 



Delayedpost (c) - Post (c) 

Positive ranks 

3 

-0.80 

0.426 


Negative ranks 

6 




Ties 

10 




Total 

19 



Delayedpost (Total) - Post (Total) 

Positive ranks 

4 

-1.20 

0.229 


Negative ranks 

8 




Ties 

7 



H r'v i i r» \ b t'x 

Total 

19 

C T-v 1 



a : Delayed Post (a) > Post (a); b : Delayed Post (a) < Post (a); c : Delayed Post (a) = Post (a) 
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Research Question 2: How do preservice chemistry teachers’ scientifically inappropriate 
classifications of each aspect of the structure of matter change from pre to post and then to 
delayed postinstruction ? 

In addition to the analysis reported in the previous section which solely focuses on the number of 
scientifically appropriate classifications, to answer the second research question, the participants’ 
scientifically inappropriate classifications were categorized and the frequencies for each type of 
scientifically inappropriate classification were determined. These inappropriate classifications 
concerning each aspect of the structure of matter were explained under the separate headings 
below. 

Scientifically inappropriate classifications related to “the physical states of matter”. 

The number of scientifically inappropriate classifications for the given particulate representations 
with respect to their physical states was not high (n=18) before the instruction, and the frequency 
of scientifically inappropriate classification cases even decreased (n=3) following the instruction 
(see Table 6). In the classification task, it appears that Picture 3 is the most challenging one for the 
participants when compared to the other pictures (see Appendix A for the pictures). Some 
participants failed to classify it as solid (misclassifying it as liquid) on the pretest (n=5), posttest 
(n=3), and delayed posttest (n=l). Moreover, the representations of gases (Picture 2 and 5) were 
misclassified as liquids by seven preservice teachers on the pretest and two preservice teachers on 
the delayed posttest. All of the preservice teachers scientifically classified these two pictures on 
the posttest. 

The participants provided the different types of explanations to justify their classification 
related to the physical states of matter. While the participants were using macroscopic level 
evidence (e.g., “taking the shape of the container” or “occupying the container”) in their written 
justifications on the pretest, many preservice teachers included submicroscopic level evidence in 
their explanations by taking into account “the distance between particles” and/or “the arrangement 
of individual particles” in the given representation on the post and delayed posttest. A participant’s 
written justifications across three testing instances showed this change: “Pictures 2 and 5 are gases, 
because gases don’t cover a certain area, they occupy the container” (pretest), “Pictures 2 and 5 are 
gases, because the molecules spread all over the container. There are much more space between 
the molecules, and they are randomly distributed” (posttest), “Pictures 2 and 5 are in gas form, 
because the particles are free from each other, they are distributed randomly, and they are 
everywhere in the box (delayed posttest)”. 

Table 6. Frequencies of types of scientifically inappropriate classifications about the physical 
states of matter on the pre, post, and delayed posttest 


Types of nonscientific classifications 

Pre 

Post 

Delayed Post 

Solid (P 1) as liquid 

1 

0 

1 

Gas (P 2) as liquid 

3 

0 

0 

Solid (P 3) as liquid 

5 

3 

1 

Liquid (P 4) as solid 

4 

0 

0 

Liquid (P 4) as gas 

1 

0 

2 

Gas (P 5) as liquid 

4 

0 

2 

Total 

18 

3 

6 
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The Picture 3 was the most inappropriately classified one by the participants. This 
particulate drawing was misclassified as liquid, although it represented a solid. One of the 
participants, on the pretest, justified his classification such that “molecules are close, but there is 
still a distance that makes it liquid.” It seems that this preservice teacher viewed liquids in-between 
the solids and gases in terms of the spacing between their atoms/molecules, and disregarded the 
ordered structure of solid particles. He then appropriately classified Picture 3 as being a solid 
following the instruction. He explained his classification, stating that “Picture 3 is solid, because 
the molecules are arranged regularly”. 

Scientifically inappropriate classifications related to “the physical composition of 
matter”. Classifying the given particulate representations with respect to their physical 
composition — in other words, whether they were pure substances, homogeneous mixtures, or 
heterogeneous mixtures — was the most difficult task for the participants in all three data collection 
instances. Compared to the other aspects of the structure of matter, there were numerous 
scientifically inappropriate classifications of the physical composition of matter on the pretest 
(n=45) (see Table 7). Following the instruction, the number of inappropriate classification cases 
considerably decreased (n=34), but on the delayed posttest, the participants’ scientifically 
inappropriate classification of the particulate representations increased again (n=40). 

Many participants appropriately classified the particulate drawing (Picture 3) representing 
an element as pure substances, but misclassified the drawing (Picture 5) representing a compound 
as homogeneous mixture (n=9) and the drawings (Picture 2 and 4) representing homogeneous 
mixtures as heterogeneous mixtures (n=27) before the instruction (see Table 7). This finding is 
very much parallel with the findings of Sanger’s (2000) study whose sample was university level 
chemistry students. Sanger indicated that “some students classified pure compounds (Picture 5) as 
mixtures because they contain two or more atom types, but as homogeneous because they look the 
same throughout the picture, and classified all mixtures (Picture 1, 2, and 4) as heterogeneous 
because they can see two different kinds of things in the mixture” (p.763). 

In the present study, many participants were confused about homogeneous and 
heterogeneous mixtures at three data collection instances. For example, on the pretest, 15 (of the 
19 participants) misclassified Picture 4, and 12 (of the 19 participants) misclassified Picture 2, as 
heterogeneous mixture, when in fact, both of these pictures represented homogeneous mixtures. 
The participants who classified homogenous mixtures as heterogeneous mixtures (Picture 2 and 4) 
generally indicated in their written justifications that these pictures had “more than one type of 
elements or compounds” and also they had an “irregular (or unequal) distribution of particles.” 


Table 7. Frequencies of types of scientifically inappropriate classifications about the physical 
composition of matter on the pre, post, and delayed posttest 


Types of nonscientific classifications 

Pre 

Post 

Delayed Post 

Heterogeneous mixture (P 1) as homogeneous mixture 

6 

6 

4 

Homogeneous mixture (P 2) as heterogeneous mixture 

12 

8 

9 

Pure substance (P 3) as homogeneous mixture 

1 

3 

4 

Homogeneous mixture (P 4) as heterogeneous mixture 

15 

13 

13 

Pure substance (P 5) as homogeneous mixture 

9 

3 

7 

Heterogeneous mixture (P 1) as pure substance 

2 

1 

3 

Total 

45 

34 

40 
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A participant who inappropriately classified a pure substance (a compound) as a 
homogenous mixture (Picture 5) stated in his written justifications that Picture 5 “included a single 
type of molecule in the gas phase, so it is a homogeneous mixture”. Thus, it might be speculated 
that some participants exhibited rather naive reasoning, assuming that “all mixtures are 
heterogeneous, and compounds are homogeneous mixtures”, previously claimed by Sanger (2000, 
p.766). In addition, it seems that the homogeneity property of compounds directed some 
participants to classify compounds as homogeneous mixtures as it was evidenced from a 
participants’ written justification, stating that “Picture 5 is homogeneous mixture because the 
molecules of this substance are distributed properly in its volume”. Similarly, more than half of the 
university students interviewed in Stain s and Talanquer’s studies (2007a, 2007b) made comments 
that revealed their inability to differentiate between the concepts of compound and mixture. 

Moreover, in the scientifically inappropriate classification of Picture 1, which is a 
representation of a heterogeneous mixture in the solid phase, some participants paid attention to 
“the ordered distribution of particles” and “the tight structure”, and this led them to categorize this 
heterogeneous mixture as a homogeneous mixture. A participant’s written justification, “Picture 1 
is a homogeneous mixture because you have a chance to take the same thing from every part of the 
container, they’re equally arranged”, might be the result of such a reasoning. 

Scientifically inappropriate classifications related to “the chemical composition of 
matter”. The number of scientifically inappropriate classifications associated with the chemical 
composition of the given particulate representations was not so high when compared to the 
physical composition aspect of the structure of matter [n=15 (pre), n=2 (post), n=13 (delayed 
post)] (see Table 8). 

In this particular classification of matter task, pictures 1 and 4 were frequently 
misclassified. Picture 1 was misclassified by some participants as being composed of compounds 
only, although it was in fact composed of both an element and a compound. Some participants 
who responded in this way perceived each line as a big molecule of a compound, even though the 
squares and the other compounds in the representation were not so close and bonded to each other. 
A justification offered by a participant reflected such an idea, which stated that “In Picture 1, there 
is only one compound present, there is no element, and all atoms are connected to the other atoms, 
so it’s a complicated compound”. A similar misperception was reported in Sanger’s study (2000), 
and this might be considered to be a limitation of this drawing; thus, that representation (Picture 1) 
should be used with caution. 

Table 8. Frequencies of types of scientifically inappropriate classifications about the chemical 
composition of matter on the pre, post, and delayed posttest 


Types of nonscientific classifications 

Pre 

Post 

Delayed Post 

Composing of both (P 1) as only compound 

5 

1 

6 

Composing of both (P 2) as only compound 

2 

0 

0 

Composing of only element (P 4) as both element and compound 

5 

0 

5 

Composing of only element (P 4) as only compound 

3 

1 

2 

Total 

15 

2 

13 
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Some participants found Picture 4 hard to classify. Although this drawing represented the 
matter containing two different elements, some participants inappropriately classified it as 
composing of a compound only or composing of both an element and a compound. One of the 
participants, on the pretest, justified his inappropriate classification such that “In Picture 4, two 
different types of atoms is connected, so it’s a compound”. This same participant appropriately 
classified this picture on the post and delayed posttest. His written justification on the posttest was 
that “Picture 4 is composed of elements, it’s actually a mixture of elements” and his delayed 
posttest justification was very similar to this. This improvement provided an evidence for the 
contribution of the instruction on the participants’ conceptual understandings. 

Conclusions 

Research has consistently reported that people in various age and schooling levels might hold 
inadequate scientific conceptions about diverse physical phenomena (e.g., Canpolat, 2006; 
Griffiths & Preston, 1992; Haidar, 1997; Margel et al., 2008; Mulford & Robinson, 2002; Novick 
& Nussbaum, 1978; Pozo & Gomez-Crespo, 2005; Valanides, 2000; Williamson et al., 2004; 
among others). This study provided additional evidence to the existing studies on different 
concepts (Calik & Ayas, 2005; Gabel et al., 1987; Ginns & Watters, 1995; Haidar, 1997; 
Valanides, 2000) and found that like other groups of students, preservice teachers also, had some 
alternative conceptualizations even about such a fundamental chemistry concept “matter”. The 
findings of a number of studies call upon chemistry teacher educators to take these alternative 
conceptualizations into consideration and design effective instructional sequences to change them 
into more scientific views. This study was an attempt to respond to this call. In this study, the 
researchers designed a specific instruction for preservice chemistry teachers (which was a missing 
aspect in previous research studies) that drew upon the theoretical and empirical evidence from 
previous studies suggesting integration of multiple representations into instruction. 

The results of the study showed that even though the preservice teachers completed 
introductory level chemistry courses, they experienced some difficulties in classifying particulate 
representations of matter prior to the specific instruction. Following the instruction, the statistical 
analysis of the data indicated that the participant preservice chemistry teachers developed more 
scientific conceptual understandings about the structure of matter and maintained their 
understandings to a great extent over a 17-month period. On the other hand, as can be seen in 
Table 2, although not statistically significant, participants’ delayed posttest mean scores for each 
aspect of the structure of matter were slightly less than their posttest mean scores. This is most 
probably because a few of the participants could not develop well-established understandings of 
the concept so that they returned to their previous nonscientific conceptions when a certain period 
of time has passed. 

Moreover, based on the evidence from the frequency of scientifically inappropriate 
classifications, the results of the study indicated that the instruction was quite effective in changing 
the participants’ particulate understandings in terms of the physical states of matter. On the other 
hand, concerning the higher number of scientifically inappropriate classifications, the instruction 
appeared not to be as effective in terms of changing the participants’ understandings about the 
physical composition of matter as compared to the extent of change in the participants’ 
understandings of the physical states of matter. This may be due to not giving an explicit attention 
to this particular aspect during the instruction. Instructional tasks were designed to help preservice 
teachers to distinguish pure substances from mixtures, but no special attention was given during 
the instruction to distinguish homogeneous mixtures from heterogeneous mixtures. 

Another finding was that the effect of the instruction for overcoming difficulties related to 
the chemical composition of matter was stronger than the other two aspects, immediately after the 
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instruction. This implied that preservice teachers were better able to identify whether a particulate 
representation composing of element/s only, compound/s only or both element/s and compound/s 
after the instruction. However, such change in preservice teachers’ understandings of chemical 
composition of matter was not durable (see Table 8), because 17 months after the instruction, some 
of the participants who misclassified the given representations with respect to the chemical 
composition of matter on the pretest reverted back to their initial classifications. 

To sum up, based on the analysis of number of scientifically appropriate classification, it 
can be concluded that the designed instruction was useful for developing the preservice chemistry 
teachers’ understandings of the particulate structure of matter and maintaining such understandings 
over a 17-month period. On the other hand, based on the analysis of change in scientifically 
inappropriate classifications for each aspect of the structure of matter, a number of preservice 
teachers developed more scientific conceptual understandings immediately after the instruction 
and maintained such understandings over a period of time. However, there were some participants 
that followed one of the following paths after the instruction: (a) A group of students developed 
scientific understandings immediately after the instruction but then they reverted back to their 
initial understandings 17 months after the instruction (e.g.. Students 1, 3, 7, 18). This provided 
further evidence about the robust nature of pre-existing nonscientific conceptions indicated in 
science education literature. The findings of previous research showed that existing nonscientific 
conceptions could never be entirely extinguished and then replaced by the scientific ideas; in fact, 
such ideas usually continue to be maintained in particular contexts (Duit & Treagust, 2003; Novak, 
1988; Taber & Tan, 2011). (b) The other group of students changed some of their scientifically 
inappropriate classifications with the scientific ones, but they also exhibited newly developed ones 
following the instruction and maintained such scientifically inappropriate classifications over a 17- 
month period (e.g., Student 3, 4, 9, 11, 13, 16). Perhaps these scientifically inappropriate 
classifications could be the instruction-induced ones such that students probably misinterpreted the 
particular concepts during the instruction and generated improper associations among the concepts 
under investigation in this study (Duit & Treagust, 2003; Mayer, 2009). Thus, such erroneous 
associations among concepts resulted in the appearance of new nonscientific classifications 
following the instruction, (c) Another group of students exhibited a kind of scientifically 
inappropriate classifications only on the delayed posttest but not on the pre and posttest (Students 
9, 16, 18, 19). These inappropriate classifications may have to do with the participants’ attention or 
further experiences over a 17-month period in other classes. That is, they might not have paid 
enough attention while offering response to the questions on the delayed posttest or they had 
different experiences in other classes over a 17-month period that directed them consider the given 
representations in a different, scientifically inappropriate, manner. 

Implications and Recommendations for Further Research 

These findings suggested that science teacher educators should not assume that preservice 
chemistry teachers possess all the required subject matter knowledge in their subject-related 
courses. Thus, activities and discussions emphasizing subject matter knowledge about fundamental 
concepts can be integrated into chemistry teacher education courses (e.g., teaching methods 
courses, practice teaching courses, etc.). Based on the findings of the present study, science teacher 
educators might consider using multiple representational tasks combined with discussions and 
collaborative work to offer preservice chemistry teachers opportunities for learning the particular 
content. Such opportunities might both help preservice teachers constructing more scientific 
conceptions and provide them ideas about how to use similar strategies in their future teaching 
careers. These types of activities might serve preservice teachers to think deeply on fundamental 
concepts of chemistry and also realize their inadequate and/or nonscientific conceptions. 
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Apart from recommendations to teacher educators, this study also offers some 
methodological suggestions to chemistry education researchers. In this study, data analyses were 
carried out according to both number of scientifically appropriate classifications and the types of 
inappropriate classifications made by preservice teachers. The results of these two types of 
analyses were quite parallel to each other and showed that a specific instruction which integrated 
the use of multiple representations promoted the development of preservice chemistry teachers’ 
scientific understandings of the structure of matter. On the other hand, it should be noted that the 
effect of the instruction appeared extremely positive based on the results of statistical analyses 
when only scientifically appropriate classifications were analyzed. When the researchers deeply 
focused on the participants’ scientifically inappropriate classifications of the structure of matter, a 
little different and more accurate picture regarding the effect of the instruction emerged. The 
difference between these two types of analyses can be considered as a methodological contribution 
of the present study. So, instead of using a single lens, the use of complementary analyses could 
provide more comprehensive information about students learning and consequently about the 
effectiveness of the instructions. 
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Appendix A 

The three-part question used for understanding preservice chemistry teachers’ conceptions about 
the structure of matter (see Sanger, 2000). 

The following drawings contain representations of atoms and molecules. Classify each of 
these drawings (labeled 1-5) according to three characteristics listed below. You should 
classify all five drawings for each category. 
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a. States of matter 


Solid Liquid Gas 

Justify your classification of each of the representations shown above as a solid, liquid, or 
gas. 

Each correct/scientifically appropriate classification is worth 1 point, so maximum score to be 
taken from this part is 5 points. Scien tifically appropriate classifications: 1 & 3 (solid); 4 (li¬ 
quid); 2 & 5 (gas) 

b. Physical composition of matter 


Pure substance Heterogeneous mixture Homogeneous mixture 

Justify your classification of each of the representations shown above as a pure 
substance, heterogeneous mixture or homogeneous mixture. 

Each correct/scientifically appropriate classification is worth 1 point, so maximum score to be 
taken from this part is 5 points. Scientifically appropriate classifications: 3 & 5 (pure 
substance); 2 & 4 (homogenous mixture); 1 (heterogeneous mixture) 

c. Chemical composition of matter 


Element Compound Both 

Justify your classification of each of the representations shown above as containing only 
element/s, only compound/s or both. 

Each correct/scientifically appropriate classification is worth 1 point, so maximum score to be 
taken from this part is 5 points. Scientifically appropriate classifications: 3 & 4 (contain only 
element/s); 5 (contains only compound/s); 1 & 2 (contain both) 

















